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(Dated: May 6, 2007) 

We report on a search for charge- 1/3 third-generation leptoquarks (LQ) produced in pp collisions 
at ^/s = 1.96 TeV using the DO detector at Fermilab. Third generation leptoquarks are assumed to 
be produced in pairs and to decay to a tau neutrino and a b quark with branching fraction B. We 
place upper limits on a(pp — > LQLQ) x B 2 as a function of the leptoquark mass Mlq ■ Assuming B = 
1, we exclude at the 95% confidence level third-generation scalar leptoquarks with Mlq < 229 GeV. 
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PACS numbers: 14.80.-j, 13.85.Rm 



Leptoquarks (LQ) are bosons predicted in many ex- 
tensions of the standard model (SM) [![. They carry 
both nonzero lepton and color quantum numbers and 
decay to a lepton and quark (or antiquark). To sat- 
isfy experimental limits on lepton number violation, on 
flavor-changing neutral currents, and on proton decay, 
leptoquarks of mass accessible to current collider experi- 
ments are constrained to couple to only one generation of 
leptons and quarks 0]. Therefore, only leptoquarks that 
couple within a single generation are considered here. 

This Letter reports the results of a search for charge- 
1/3 third-generation leptoquarks produced in pp colli- 
sions at s/s = 1.96 TeV. We assume that leptoquarks are 
produced in pairs by qq annihilation or gg fusion, i.e., 
p + p — > LQ + LQ + X. These processes are indepen- 
dent of the unknown leptoquark-lepton-quark coupling, 
and the pair production cross section has been calcu- 
lated including next-to-leading order terms for scalar lep- 
toquarks Q . Such leptoquarks would decay into either a 
v T plus a b quark or a r lepton plus a t quark. We search 
for the decay signature where both leptoquarks decay via 
LQ — > v T + b with branching fraction B, resulting in a 
v T v r bb final state. Upper limits on the cross section times 
B 2 as a function of leptoquark mass (Mlq) are measured 
and then used to determine lower limits on Mlq assum- 
ing they are scalar for which the calculated cross section 
is lower and better determined than that for vector lepto- 
quarks which have only been calculated to leading order 
[4|. Previous limits from Fermilab Run I data were re- 
ported by both the DO 5] and CDF @, 0] collaborations 
based on significantly smaller integrated luminosities and 
at a slightly lower center-of-mass energy compared with 
the Run II data available now. 

The upgraded Run II DO detector [f| consists of layered 
systems surrounding the interaction point. Closest to the 
beam are the silicon microstrip tracker and a central fiber 
tracker, both immersed in the field of a 2 T solenoid. 
These measure the momenta of charged particles and re- 
construct primary and secondary vertices. Jets and elec- 
trons are reconstructed using the pattern of energy de- 
posited in three uranium/liquid-argon calorimeters out- 
side the tracking system with a central section covering 
1 77 1 < 1.1 and two end calorimeters housed in separate 
cryostats covering the regions up to \ri\ ~ 4 (where r) 
= — ln[tan(0/2)] is the pseudorapidity, and 8 is the po- 
lar angle with respect to the proton beam direction). 
Jet reconstruction uses a cone algorithm [j| with radius 
1Z = y/ (Arj) 2 + (Ac/)) 2 = 0.5 in pseudorapidity and az- 
imuthal angle (</>) space about the jet's axis. The jet 
energy scale was calibrated using the transverse energy 
balance in photon-plus-jet events [loj ] . A muon system 
outside the calorimeters consists of a layer of drift tubes 
and scintillation counters before 1.8 T iron toroids and 



two similar layers outside the toroids. Identified muons 
were required to have hits in both the wire chambers and 
scintillation counters and were matched to a central track 
which determined their momenta. The missing trans- 
verse energy, fx, was determined by the vector sum of 
the transverse components of the energy deposited in the 
calorimeter and the px of detected muons. 

Data collection used a three level trigger system and 
two trigger selections were analyzed for the results pre- 
sented here. The first, called the missing energy trig- 
ger here, used missing energy plus jets elements. At 
Level 1 it required at least three calorimeter trigger tow- 
ers with Et > 5 GeV, where a trigger tower spans 
A(f> x A77 = 0.2 x 0.2. The vector sum of all jets' trans- 
verse momenta, defined as I/I? = | Yljeta P* I > was required 
to be greater than 20 GeV at Level 2 and greater than 
30 GeV at Level 3. For 16% of the integrated luminosity, 
the acoplanarity, defined as the azimuthal angle between 
the two leading jets, was required to be less than 169° 
and the Ht = Ylje-ts ^ e § rea ter than 50 GeV. An in- 
tegrated luminosity of 360 pb _1 JjJ was collected with 
this trigger. The second trigger, called the muon trigger 
here, used muon and jet elements to increase the accep- 
tance for events where one of the b jets was identified 
by its associated muon. At Level 1 it required at least 
one muon candidate and at least one calorimeter trig- 
ger tower with Et > 3 GeV. Higher jet thresholds were 
imposed at Level 2 and finally 25 GeV at Level 3. An 
integrated luminosity of 425 pb" 1 was collected with the 
muon trigger. These missing energy and muon triggers 
were not independent and only the 65 pb _1 of the muon 
trigger data sample which does not overlap was used for 
the combined result. 

Signal samples for leptoquark masses between 150 and 
400 GeV were generated with pythia 6.202 [HI]. In- 
strumental background comes mostly from QCD multi- 
jet processes with false fx arising from mismeasurement, 
and dominates the low fir region. Physics backgrounds 
are SM processes with real and were estimated from 
Monte Carlo (MC) simulations. The most important are 
leptonic decays of W/Z bosons plus jets with Z — ► vv 
or when a lepton remains unidentified or is misidentified 
as a hadron, and processes which produce top quarks. 
For all MC samples except tt and single top quark, the 
next-to-leading order cross sections were obtained from 
Ref. [HI]. Cross sections for ti and single top quark pro- 
duction were taken from Ref. 14 1 and [HI], respectively. 
At the parton level, single top quark MC events were gen- 
erated with COMPHEP 4.4 [lij], and ALPGEN [13] was used 
for all other samples. These events were then processed 
with pythia which performed showering and hadroniza- 
tion. An average of 0.8 minimum bias events was su- 
perimposed on each MC event to match the number of 



5 



TABLE I: Predicted numbers of signal and background events before b tagging and after all requirements (statistical errors 
only). 



Data sample 


Missing energy trig 


ger 360 pb 1 


Muon trigj 


;er 425 pb 1 


Process 


Pretag requirements 


All requirements 


Pretag requirements 


All requirements 


W — > [iv + jj 


108 ± 6 


0.28 ± 0.11 


100 ± 7 


0.06 ± 0.06 


W — ► eu + jj 


160 ± 14 


0.02 ± 0.01 


6 ± 3 





W —* TV + jj 


396 ± 36 


0.17 ± 0.05 


7 ± 5 





Z -> vv + jj 


603 ± 18 


0.45 ± 0.16 


25 ± 4 





tt and single top 


36 ± 1 


1.42 ± 0.11 


18 ± 0.6 


0.80 ± 0.11 


W/Z + cc 


18 ± 1 


0.46 ± 0.11 


3.01 ± 0.49 


0.21 ± 0.12 


Z + bb 


6 ± 1 


0.67 ± 0.08 


1.89 ± 0.20 


0.22 ± 0.06 


W + bb 


8 ± 1 


0.59 ± 0.11 


4.43 ± 0.38 


0.41 ± 0.11 


Total SM expected 


1335 ± 43 


4.1 ± 0.3 


165 ± 10 


1.7 ± 0.2 


QCD contribution 


40 ± 40 


< 0.1 


6 ± 6 


< 0.2 


Data 


1241 


1 


146 





Signal Mlq = 200 GeV 


34 ± 1 


10.1 ± 0.3 


9.6 ± 0.4 


3.8 ± 0.2 


Signal acceptance 


35.9% 


10.4% 


8.4% 


3.3% 



additional collisions observed in data. The resulting sam- 
ples were processed using a full GEANT simulation of the 
DO detector [T3|. CTEQ5L [IS] was used as the parton 
density function in all cases. 

For both data samples, a set of preselection require- 
ments was applied prior to b tagging in order to reduce 
the number of events from QCD multijet and W/Z+]ets 
processes. Values for preselection cuts and jet quality 
criteria were driven by trigger requirements. To reject 
W — ► Iv decays, a veto was applied to events with iso- 
lated electrons or muons with px > 5 GeV. Likewise, 
events containing a track with tighter isolation cuts and 
with pt > 5 GeV were rejected to reduce the contribu- 
tion of lcptons which remained unidentified. The num- 
ber of events with mismeasured fx was reduced by re- 
quiring that the primary vertex be within ±60 cm in 
the beam direction from the center of the detector and 
by eliminating those where the |?t direction and a jet 
overlapped in <f>. For the missing energy trigger sample, 
events were required to have IpT > 70 GeV, the leading 
jet was required to have |?7| < 1.5 and pr > 40 GeV, 
and, for events without muons, scalar Ht > 110 GeV. 
For the muon triggered sample, the preselection required 
a muon with px > 4 GeV and a leading jet with \r/\ < 1.5 
and pr > 40 GeV (> 50 GeV if not associated with a 
muon). Additional requirements were a second jet with 
p T > 20 GeV, I/It > 50 GeV and $ T > 70 GeV. The 
numbers of pre-selected events in both samples and their 
estimated sources are given in Table |TJ 

Figure Q] shows distributions of $t and Ht with the 
signal LQ and background SM events normalized to the 
total integrated luminosity. The data samples reproduce 
the SM expectations for IpT > 90 GeV indicating that 
contributions from QCD multijet processes are small in 
this range. The contribution from these events is esti- 
mated from the $t distribution below 70 GeV by a fit to 
an exponential after subtracting SM contributions. This 



is similar to the technique used in our search for scalar 
bottom quarks '2Q\ and total, for $ T > 70 GeV, 40 ± 40 
events and 6 ± 6 events in the missing energy and muon 
trigger samples, respectively. After b tagging, which is 
described below, the contributions from this source are 
less than 0.1 and 0.2 events respectively, and a value of 
events was conservatively used for limit calculations. 

Backgrounds with light flavor jets were reduced by re- 
quiring the presence of ^-tagged jets. We used jets that 
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FIG. 1: The $t distributions and the scalar Ht (with 
$t > 70 GeV) distributions before b tagging for data (points) 
compared to SM background (solid histogram). The missing 
energy trigger sample is given in (a) and (b) and the muon 
trigger sample in (c) and (d). The shaded histograms are the 
expected contribution for a 200 GeV LQ signal. 



6 



TABLE II: Numbers of observed and predicted events after final selection, the effective signal acceptance (with total error), 
and the observed and expected 95% C.L. cross section limits as a function of Mlq- Scalar cross sections were used to calculate 
the expected numbers of signal events. 



Mlq 


{$r, H T ) a 


Data 


SM ± stat ± sys 


Signal ± stat ± sys 


Effective 


a 95% C.L. limit 


GeV 


GeV 


C V C11LO 


C V C11LO 


C V C11LO 


ClUjC U L dllUt/ I /U ) 


n rit; / pvn ( x\ r> 1 

UUB./ CAU . 1 VJ U I 


170 


(70,110) 


4 


7.3 ± 0.4 ± 1.7 


27.0 ± 0.6 ± 4.6 


10.4 ± 1.5 


0.163/0.232 


200 


(90,150) 


1 


4.3 ± 0.3 ± 1.0 


10.7 ± 0.3 ± 1.7 


11.1 ± 1.6 


0.101/0.163 


220 


(90,190) 


1 


3.3 ± 0.3 ± 0.7 


5.8 ± 0.2 ± 0.9 


11.5 ± 1.6 


0.097/0.142 


240 


(90,190) 


1 


3.3 ± 0.3 ± 0.7 


3.7 ± 0.1 ± 0.6 


13.6 ± 2.0 


0.081/0.119 


280 


(90,190) 


1 


3.3 ± 0.3 ± 0.7 


1.3 ± 0.0 ± 0.2 


15.5 ± 2.2 


0.071/0.105 


320 


(90,190) 


1 


3.3 ± 0.3 ± 0.7 




17.5 ± 2.5 


0.063/0.092 


360 


(90,190) 


1 


3.3 ± 0.3 ± 0.7 




18.9 ± 2.7 


0.058/0.085 


400 


(90,190) 


1 


3.3 ± 0.3 ± 0.7 




21.6 ± 3.1 


0.051/0.074 



a $ T > 70 GeV, H T >140 GeV applied to all muon-tagged events. 



contained either tracks with a significant impact param- 
eter or muons to select 6-jet candidates. Events were 
required to have two b tags with at least one passing the 
impact parameter criterion. For events selected with the 
muon trigger, a b jet tagged using a reconstructed muon 
in proximity to a jet was required. Otherwise, the events 
from both trigger samples were treated in an identical 
way for the remainder of the analysis. 

We assigned a b probability to a jet based on prop- 
erties such as the existence of tracks with a significant 
impact paramater that indicated the presence of a sec- 
ondary vertex. The algorithm 2l| required at least two 
tracks in a jet, each with a hit in the silicon tracker. 
Tagging probabilities in simulated jets used parameteri- 
zations derived from data. The probability of a jet to be 
of light flavor was derived and required to be less than 
2%, which yielded a 6-tag efficiency of about 45% per b 
jet. This choice maximized the expected LQ mass limits 
after all other cuts were applied. 

Muon-tagged jets were also considered fe-jet candi- 
dates. Muon thresholds were raised to p T > 6 GeV 
to suppress contributions from tt/K decays. Remain- 
ing backgrounds from W boson decays to muons were 
due to accidental overlap of a muon with a nearby jet. 
We required that the sum of track px in a cone of 0.5 
around the muon be greater than 10 GeV, and that the 
approximate of the muon relative to the jet's axis, 



p T , be less than 3.5 GeV, as muons originat- 



AK 

ing from jets are closer to the jet axis for higher values 
of pt . These requirements are not independent and 
combining them was found to reduce the W boson back- 
ground by 95% while keeping 77% of the signal. Muon 
tagging has a &-tag efficiency of about 11% with less than 
0.5% of light flavored jets passing the tag criteria. 

Since signal events are dominated by high energy b 
jets, the quantity Xjj = (p^ gl +py s2 )/(Sj e tsPT) was de- 
fined, with the muon pt included in the pr of the tagged 
jet, where applicable. We required Xjj > 0.8 which was 
found to significantly reduce the contribution from top 
quark pair events. Since f!x and Ht increase for higher 



values of Mlq, we optimized the requirements on these 
parameters as a function of leptoquark mass by maxi- 
mizing S/y/B, where S and B are estimated signal and 
background rates. The values used for the minimum Ht 
and fx are given in Table [Til and were applied only to 
the double b vertex tagged sample. For the muon-tagged 
events, the Ht > 140 GeV requirement was applied, and 
the IfjT cut remained at 70 GeV as these events have a 
smaller contribution from light flavor jets. 

Results of the final event selection along with predicted 
numbers for signal {Mlq — 200 GeV) and SM back- 
grounds are listed in Table UJ The latter originate mostly 
from W/Z + bb production and top quark events. 

Sources of systematic uncertainties include errors in 
the determination of the integrated luminosity (6.1%) 



ll| and SM cross sections (15%). Trigger and jet se- 



lection efficiencies were measured with data and their 
contribution to the systematic errors is small. Jet en- 
ergies and f*T were varied within the energy scale cor- 
rection uncertainty, and the impact on signal acceptance 
and background rates was determined with MC to be 3% 
and 10% respectively. Jet ^-tagging efficiency uncertain- 
ties are 12% for signal and 11% for background. 

One event remains in the combined data sam- 
ple for the selection criteria used for all points 
with Mlq > 200 GeV. This is consistent with the 
3.3 ± 0.3 ± 0.7 expected events from SM processes. The 
probability of the observed deficit is 16%. The 95% C.L. 
upper limits on the <r(pp — > LQLQ — > vvbb) x B 2 were 
obtained using the techniques in Ref. [23T| . The effective 
signal acceptances of the combined sample (normalized 
to 360 pb _1 ), numbers of events, and the resulting limits 
as functions of Mlq are summarized in Table HTJ 

Figure [5] shows the cross section limit as a function 
of Mlq- Limits on the scalar leptoquark mass were ob- 
tained by the intersections of the observed 95% C.L. cross 
section limits with the lower bounds of a next-to-leading 
order calculation for which variation of the renormaliza- 
tion scale \i from Q.5Mlq to IMlq and the PDF un- 
certainties [2^ were included. If B{LQ — * v T b) = 1 is 
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FIG. 2: The 95% C.L. limit on a x B 2 (points plus solid 
line) as a function of Mlq. The prediction for scalar lep- 
toquarks (solid line) include an error range (in grey) of fj, 
between 0.5Mlq and 2Mlq- The long-dashed line below the 
theory band indicates the threshold effect for the rt channel. 



assumed, our limit is M L q > 229 GeV. We can also 
consider the case where LQ — > tr decays occur. If we 
assume that the leptoquark couplings to v T b and tr are 
the same, the branching fraction for LQ — > v T b is then 
1 — 0.5 x F sp where F sp is the phase space suppression 
factor for the tr channel (25|. This is shown on the fig- 
ure as a displacement from the lower edge of the theory 
band. With this assumption, the 95% C.L. lower mass 
limit for scalar leptoquarks is 221 GeV. 



In conclusion, we observe one event with the topology 
bb + consistent with that expected from top quark 
and W and Z boson production and set limits on the 
cross section times branching fraction squared to the bv 
final state as a function of leptoquark mass for charge- 1/3 
leptoquarks. These limits are interpreted as mass limits 
for third-generation scalar leptoquarks and increase the 
excluded value by 81 GeV compared to previous results. 

We thank the staffs at Fermilab and collaborating in- 
stitutions, and acknowledge support from the DOE and 
NSF (USA); CEA and CNRS/IN2P3 (France); FASI, 
Rosatom and RFBR (Russia); CAPES, CNPq, FAPERJ, 
FAPESP and FUNDUNESP (Brazil); DAE and DST 
(India); Colciencias (Colombia); CONACyT (Mexico); 
KRF and KOSEF (Korea); CONICET and UBACyT 
(Argentina); FOM (The Netherlands); Science and Tech- 
nology Facilities Council (United Kingdom); MSMT and 
GACR (Czech Republic); CRC Program, CFI, NSERC 
and WestGrid Project (Canada); BMBF and DFG (Ger- 
many); SFI (Ireland); The Swedish Research Council 
(Sweden); CAS and CNSF (China); Alexander von Hum- 
boldt Foundation; and the Marie Curie Program. 



76, 



Phys. Rev. Lett. 81, 
Phys. Rev. Lett. 85, 



Phys. Rev. Lett. 78, 



Nucl. Instrum. Meth. 



[*] Visitor from Augustana College, Sioux Falls, SD, USA. 
[%\ Visitor from The University of Liverpool, Liverpool, UK. 
[§] Visitor from ICN-UNAM, Mexico City, Mexico. 
[J] Visitor from Helsinki Institute of Physics, Helsinki, Fin- 
land. 

[#] Visitor from Universitat Zurich, Zurich, Switzerland. 

[1] J.C. Pati and A. Salam, Phys. Rev. D 10, 275 (1974); 

E. Eichten et al., Phys. Rev. D 34, 1547 (1986); W. 

Buchmiiller and D. Wyler, Phys. Lett. B 177, 377 (1986); 

E. Eichten et al., Phys. Rev. Lett. 50, 811 (1983); H. 

Georgi and S. Glashow, Phys. Rev. Lett. 32, 438 (1994). 
[2] M. Leurer, Phys. Rev. D 49, 333 (1994); S. Davidson, 

D.C. Bailey, and R.A. Campbell, Z. Phys. C 61, 613 

(1994); O. Shanker, Nucl. Phys. B 204, 375 (1982). 
[3] M. Kramer, T. Plehn, M. Spira and P. M. Zerwas, Phys. 

Rev. Lett. 79, 341 (1997). 
[4] J. Bliimlein, E. Boos, and A. Kryukov, Z. Phys. C 

137 (1997). 
[5] DO Collaboration, B. Abbott et al. 

38 (1998). 
[6] CDF Collaboration, F. Abe et al, 

2056 (2000). 
[7] CDF Collaboration, F. Abe et al, 

2906 (1997). 
[8] DO Collaboration, V. Abazov et al.. 

A 565, 463 (2006). 
[9] G.C. Blazey et al, in Proceedings of the Workshop "QCD 

and Weak Boson Physics in Run II," edited by U. Baur, 

R.K. Ellis, and D. Zeppenfeld (Fermilab, 2000) p. 
[10] DO C ollaboration, V. Abazov et 

arXiv:hep-ex/0702018 to be published in 

Rev. D. 

[11] T. Andeen et al, FERMILAB-TM-2365-E (2006). 
[12] T. Sjostrand et al, Computer Phys. Commun. 135, 
(2001). 

[13] J.M Campbell and R.K. Ellis, 

(1999) ; 

J.M Campbell and R.K. Ellis, 

(2000) . 

[14] DO Collaboration, V. Abazov et al, Phys. Rev. D 74, 

112004 (2006). 
[15] B.W. Harris et al, Phys. Rev. D 66, 054024 (2002). 
[16] CompHEP Collaboration, E. Boos et al, Nucl. Instrum. 

Methods A 534, 250 (2004). 
[17] ML Mangano et al, JHEP 0307 (2003). 
[18] A. Agostinelli et al, Nucl. Instrum. Methods A 506, 250- 

303 (2003). 

[19] H.L. Lai et al, Eur. Phys. J. C12, 375 (2000). 

[20] DO Collaboration, V.M. Abazov et al, Phys. Rev. Lett. 

97, 171806 (2006). 
[21] B. Clement, Ph.D. thesis, Universite Louis Pasteur, 
Strasbourg, N° d'ordre IPHC 06-004, N° d'ordre ULP 
5086, FERMILAB-THESIS-2006-06 (2006). 
[22] V. Barger and R. Phillips, "Collider Physics," 

(Addison- Wesley Pub. Co., Redwood City, CA, 1987). 
[23] T. Junk, Nucl. Instrum. Methods A 434, 435 (1999). 
[24] J. Pumplin et al, JHEP 0207, 012 (2002). 
[25] 



47. 

al, 
Phys. 



238 

Phys. Rev. D 60, 113006 
Phys. Rev. D 62, 114012 



We used B(LQ 
v/(l + di - d 2 ) 2 -4di[l 
and d 2 = (m T /M L Q) 2 . 



0.5 x F s , 



where F s „ = 



vb) = 1 

-di— da], with di = (m t /M L Q) 2 
T. Rizzo (private communica- 



tion). 



